Evaluating Educational Software

This paper presents the overall evaluation of the Quantitative Evaluation Framework (QEF) approach which has been applied in an operational teaching environment for the last six years. During this period we have evaluated the difference between educational software systems that were developed using the Techno-Didactical Extension for Instruction/Learning Based on Computer (X-TEC) model and educational software systems using other models. The X-TEC model is used in the development of educational software in order to strengthen the potential quality of e-Learning systems. We selected the QEF approach for this evaluation to highlight the strengths and limitations of the X-TEC model. We adapted the approach in a way where the essential criteria are assessed in a pre-evaluation phase which will cover the general usage requirements. In this research project we conduct experiments with groups of students and teachers in Multimedia Information Systems classes of Oporto Polytechnic, to examine the influence of training in an instructional system design approach on their attitude to re-use this approach and on their performances in design, using this approach.